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© An apparatus for modifying a database query 
including means (300) for graphically displaying in at 
least two dimensions data (330) obtained from a 
database by the database query, means (335) for 
selecting at least one portion of the graphically dis- 
played data (330), and means for modifying the 
database query according to the selected portion of 
the graphically displayed data (330). In addition, a 
method for modifying a database query including the 
steps of graphically displaying in at least two dimen- 
sions data (330) obtained from a database by the 
database query, selecting at least one portion of the 
graphically displayed data (330), and modifying the 
database query according to the selected portion of 
the graphically displayed data (330). 
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This invention relates generally to computer 
stored databases and more particularly to a meth- 
od and apparatus for modifying a database query 
utilizing a graphical user interface. 

Computer stored databases have attracted an 
increasing amount of interest, not only because of 
the rapid expansion in the data stored and re- 
trieved by these databases, but also as a result of 
the data relationships which can be established 
during the storage or retrieval processes. With the 
growing prevalence of relational databases, the 
training and experience of a typical end user has 
decreased as available resources have increased. 
Novice users of databases have been particularly 
desirous of improvements in the graphical user 
interfaces to control the database applications. 

One of the more difficult elements of problem 
solving when using a database is often the iden- 
tification of the sources that causes a particular 
problem. Search statements for queries are usually 
used for searching information stored in a database 
in an organized fashion to help problem solving. 
When users have few clear ideas about how to 
construct the problem query for solving a problem, 
a common approach is to start by examining an 
initial query report resultant from an initial query for 
more information. Based on this information, the 
user then decides how to narrow the search further 
within the database. If these narrowed searches do 
not produce the desired result then the user must 
back up to a previous search statement and try 
again. 

Current search techniques are cumbersome, 
inhibiting efficient query formulation. Usually, query 
reports are output only and query formulations are 
input only. When users have no ideas about what 
exact information is required by a problem, they 
tend to look in initial query report for more informa- 
tion and then decide how to narrow the search 
further by modifying the query formulation. 

The above drawbacks of the prior art are over- 
come by the invention as claimed. 

Accordingly, the present invention includes an 
apparatus for modifying a database query including 
apparatus for graphically displaying in at least two 
dimensions data obtained from a database by the 
database query, apparatus for selecting at least 
one portion of the graphically displayed data, and 
apparatus for modifying the database query ac- 
cording to the selected portion of the graphically 
displayed data. In addition, the present invention 
includes a method for modifying a database query 
including the steps of graphically displaying in at 
least two dimensions data obtained from a 
database by the database query, selecting at least 
one portion of the graphically displayed data, and 
modifying the database query according to the 
selected portion of the graphically displayed data. 



A further understanding of the nature and ad- 
vantages of the present invention may be realized 
by reference to the remaining portions of the speci- 
fication and the drawings, where: 
5 Fig. 1 is a block diagram of a typical digital 
computer utilized by a preferred embodiment of 
the invention; 

Figs. 2A-2B illustrate generating and utilizing a 
pie chart according to a preferred embodiment 
w of the invention; 

Figs. 3A-3E illustrate generating and utilizing 
various charts according to a preferred embodi- 
ment of the invention; 

Figs. 4A-4C illustrate a flowchart for performing 
w a preferred embodiment of the invention; and 

Fig. 5 illustrates generating and utilizing a mul- 
timedia application according to a preferred em- 
bodiment of the invention. 
This disclosure describes a graphical user in- 
20 terface that allows a user to dynamically update a 
database query statement. In the preferred embodi- 
ment, the user should be able to specify an area, a 
category, or a section in a an output graph for 
generating conditions to the database query state- 
25 ment. These graphs could include line graphs, bar 
charts, pie charts and other well known methods of 
displaying output in a graphical manner. In addi- 
tion, a check box facility may be used as described 
below. Direct manipulation of the graph then results 
30 in corresponding changes to the database query 
that was used to generate the graph, resulting in a 
more complete problem solving tool. 

Incorporated by reference is copending EP-A 
94107108.6 filed on the same date as the present 
35 application, entitled "Method and system for 
searching a database utilizing a graphical user in- 
terface". 

Fig. 1 is a block diagram of a typical digital 
computer 100 utilized by a preferred embodiment 

40 of the invention. The computer includes main 
processor(s) 110 coupled to a main memory 120 in 
computer box 105 with input device(s) 130 and 
output device(s) 140 attached. Main Processor(s) 
110 may include a single processor or multiple 

45 processors. Input device(s) 130 may include a key- 
board, mouse, tablet or other types of input de- 
vices. Output device(s) 140 may include a text 
monitor, plotter or other types of output devices. 
The main processor may also be coupled to graph- 

50 ics output device(s) 210 such as a graphics display 
through a graphics adapter 200. Graphics adapter 
200 may be located in an adapter slot 160A. 
Graphics adapter 200 receives instructions regard- 
ing graphics from main processor 110 on bus 150, 

55 thereby rendering the desired graphics output from 
the main processor. A modem or other commu- 
nications adapter 250 and a hard disk 255 may 
also be located in slots 160C and 160D to provide 
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communications with main processor 110 across 
bus 150. Modem 250 may communicate with other 
data processing systems 270 across communica- 
tions line 260. Computer readable removable me- 
dia 290, such as a magnetic diskette or a compact 
disc, may be inserted into an input/output device 
285, such as a disk drive or a CD-ROM (compact 
disc - read only memory) driver. Data is read from 
or written to the removable media by the I/O device 
under the control of the I/O device controller 280. 
The I/O device controller communicates with the 
main processor through slot 160E across bus 150. 
Main memory 120, hard disk 255 and removable 
media 290 are all referred to as memory for storing 
data for processing by main processor 110. 

The power and usability of database graphic 
solutions, particularly business graphic solutions, 
could be drastically improved by allowing user 
input on the graphic output screens. When looking 
at a graph, the user may discover a certain range 
of attribute values that needs to be investigated 
further. In the preferred embodiment, an input ca- 
pability is integrated into the graphical output such 
that the graph becomes a combination of informa- 
tion display and input vehicle. Using such an in- 
tegrated system, the user may define conditions 
directly on the graphical output, thereby modifying 
the database query that was used to generate the 
graphical output. This query modification capability 
can either be invoked automatically when the graph 
is displayed or be explicitly started by a user 
action. 

Figs. 2A-2B illustrate generating and utilizing a 
pie chart according to a preferred embodiment of 
the invention. For a pie chart, each piece of pie 
displays specific information belonging to a certain 
category. In Fig. 2A, a display 300 has two open 
windows, a query window 310 and a graph window 
320. As illustrated, the user has already entered a 
database query statement into query window 310 
and the system has read the database and gen- 
erated a pie chart 330 in the graph window 320. In 
the illustrated example, any categories with small 
percentages are automatically grouped into a cate- 
gory called "OTHERS". In the preferred embodi- 
ment, check boxes 335 are provided in each cate- 
gory of the pie chart. Using a mouse, the user may 
request more detailed information about a category 
by using a mouse to move the cursor over a check 
box corresponding to the desired category and 
clicking the mouse button. The check box may also 
be turned back off by merely clicking the mouse 
button again. As shown in Fig. 2B, when a check 
box for a category such as "SONY" is checked, 
the query statement used to generate the original 
chart is modified to reflect the selection. In addi- 
tion, the user may select multiple categories by 
selecting multiple check boxes. When multiple 



boxes are checked, these conditions are preferably 
in logical OR relationships with each other. In an 
alternative embodiment, rather than using a check 
box or boxes, the user may select one or more 

5 categories by simply selecting the desired portion 
or portions of the pie chart. As each selection is 
made, the query statement displayed in the query 
window is modified to reflect the selection. The 
user may also perform additional modifications to 

w the query statement directly in the query window. 
Upon completing the selection process, the user 
may then press enter or press a second mouse 
button. The database will be queried with the modi- 
fied query statement and the results will be dis- 

15 played in the graph window. At this point, the user 
may again modify the query statement by selecting 
portions of the graph or by modifying the query 
statement in the query window. 

Figs. 3A-3E illustrate generating and utilizing 

20 various charts according to a preferred embodi- 
ment of the invention. In Fig. 3A, display 300 has 
the same two open windows described above with 
reference to Fig. 2A, query window 310 and graph 
window 320. As illustrated, the user has already 

25 entered a database query statement into query 
window 310 and the system has read the database 
and generated a bar chart 340 in graph window 
320. For a bar chart, each bar displays specific 
information belonging to a certain category. In the 

30 preferred embodiment, check boxes 335 are pro- 
vided below each category of the bar chart for use 
as described above with reference to the pie chart. 
In an alternative embodiment, the user may select 
a desired bar rather than selecting a corresponding 

35 check box. Fig. 3B illustrates that the user has 
selected the third quarter to see why sales may 
have dipped in that quarter. However, the user may 
want to see the results in a line chart to more fully 
understand the data. Therefore, as is well known in 

40 the art, the user may select from a pull down menu 
that the result of the modified query be displayed 
as a line chart. 

Fig. 3C illustrates that selection with a line 
chart 350. At this point, the user may wish to see 

45 more details about the two downturns that oc- 
curred. For a line chart or a scatter diagram, a box 
(or cube for 3-d graphs) is preferably used to 
select one or more areas of the chart for further 
investigation. As shown in Fig. 3D, rectangular 

50 boxes 355 and 356 may be used to specify a 
ranges of values to be inspected in greater detail. 
For unambiguous interpretation on the attribute val- 
ues represented in a graph's X axis or Y axis, the 
box is preferably maintained in a horizontal or 

55 vertical orientation. This box can be directly ma- 
nipulated by a user to change its size, shape, and 
location. The user can drag a corner of the box to 
re-size it or drag the inner area of the box to move 
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it. The user can invoke multiple boxes as illustrated 
to generate multiple sets of conditions. As shown in 
Fig. 3D, the query statement has been modified by 
the location of the boxes. Once the user presses 
enter or clicks a second button on the mouse, Fig. 
3E is generated to reflect the selection. As shown 
in Fig. 3E, there occurred a no sale day before 
each downturn in sales that was not visible in the 
previous higher level charts. The user can now 
research how these no sale days occurred to un- 
derstand why sales dipped in the third quarter. It is 
readily apparent that the present invention provides 
easily accessed, powerful, and iterative capabilities 
to the user to aid in problem solving and data 
presentation. 

Figs. 4A-4C illustrate a flowchart for performing 
a preferred embodiment of the invention. In a first 
step 500, query and graph windows are displayed. 
In step 510, the user provides a query statement. 
In step 520, the processing system executes the 
query, thereby retrieving data from a database for 
display. In step 530, it is determined whether this is 
a new graph or query or whether the query fields 
are different. If so, then in step 540 the graph type 
is obtained from the user. 

In step 550, if the graph type is a bar or pie 
chart then processing continues to step 560. In 
step 560, the user chooses a result field to repre- 
sent the text labels for each bar or wedge. In step 
570, for each section the user chooses a result 
field to represent the sides of each bar or wedge. 
In step 580, the pie or bar graph is then drawn 
according to the user specifications. Then, in step 
590, a check box is drawn under each bar or within 
each wedge. In step 600, the user may then click 
on any desired check boxes and press enter. In 
step 610, if the user clicked on any check boxes, 
then processing continues to step 620 else pro- 
cessing continues to step 630. In step 620, an "and 
(" clause is appended to a WHERE clause in the 
query statement in the preferred embodiment. This 
step is to limit the query statement to select data 
from the database corresponding to the user se- 
lected portions of the graph. In step 630, for each 
check box clicked by the user, a corresponding 
modification is made to the query statement. That 
is, each category or range selected is OR'd with 
each other category or range selected so that the 
query statement will obtain data from the database 
corresponding to each selected portion of the 
graph. In step 640, an ")" is appended to the end 
of the WHERE clause. In step 650 the modified 
query is then executed and the result is obtained 
from the database and stored in the result buffer. In 
step 660, the graph window is displayed and pro- 
cessing returns to step 530. 

In step 550, if the graph type is not a value 
type bar or pie chart, then processing continues to 



step 700. In step 700, if it is determined whether 
the graph type is a histogram type bar or pie chart 
then processing continues to step 705. If it is 
determined that in step 705 that the graph type is a 

5 bar chart, then in step 710 the user enters the units 
for a Y axis of the graph. In step 720, the user 
enters an expression for each bar or wedge of the 
graph. In step 730, the pie or bar graph is drawn 
according to the user's specifications. In step 740, 

10 a check box is drawn under each bar or within 
each wedge. In step 750, the user clicks on any 
desired check boxes and presses enter. In step 
760, if the user clicks on any check boxes, then in 
step 770 an "AND (" is appended to the query 

15 statement. In step 780, for each check box clicked 
by the user, a corresponding modification is made 
to the query statement as described above with 
reference to step 630. In step 790, an ")" is appen- 
ded to the end of the where clause. Processing 

20 then continues to step 650 as described above. 

In step 700, if it is determined that the graph 
type is not a histogram type bar or pie chart, then 
processing continues to step 800. In step 800, the 
user enters labels for the X and Y axis. In steps 

25 810 and 820, the user enters result fields or ex- 
pression to be graphed as the X and Y axis values. 
In step 830, the line or scatter chart is drawn to 
user specifications. In step 840, the user generates 
selection boxes around any desired ranges of the 

30 line or scatter chart. If, in step 850, it is determined 
that the user generated some selection boxes, then 
in step 860 an "AND (" is appended to the query 
statement. In steps 870 and 880, for each selection 
box generated by the user, a corresponding modi- 

35 fication is made to the query statement as de- 
scribed above with reference to step 630. In step 
890, an ")" is appended to the end of the where 
clause. Processing then continues to step 650 as 
described above. 

40 Throughout the above described process, the 

user may use the mouse to click on the query 
window in step 900. If so, then in step 910, the 
existing query is displayed in the query window. In 
step 920, the user may then type in any modifica- 

45 tions to the query or type in a new query. Process- 
ing then continues to step 650 as described above. 
The user may also use the mouse to click on a pull 
down menu bar to change the graph information in 
step 950. If so, then processing continues to step 

50 540 as described above. 

The present invention is not restricted to two 
dimensional graphics. Using the techniques defined 
herein, the present invention can also be easily 
applied to three dimensional graphics. The im- 

55 plementation would be a logical extension of the 
above described processes, and will be readily 
apparent to one of ordinary skill in the art. For 
example, for three dimensional bar or sphere 
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charts, the user could select the desired categories 
directly with a mouse or check boxes could be 
provided for each region. For three dimensional 
surface charts, the user could utilize a three dimen- 
sional cube instead of a two dimensional box as 
described above with reference to the line chart. To 
avoid any ambiguity in utilizing a three dimensional 
box, the box would preferably maintain its (x,y,z) 
axis orientations during user manipulation. In inter- 
preting the effects of direct manipulations on this 
box, this (x,y,z) axis orientation will be used to 
determine the meaning of a dragging operations. 
That is, when a corner of the box is dragged, the 
box is resized according to the new location of the 
corner. The user could then toggle between the X- 
Y, X-Z, and Y-Z planes for the movement of the 
corner to avoid ambiguity. When a side surface of 
the box is dragged, the box could be relocated 
accordingly. The user could also drag endpoints 
defined on the x, y, and z axis. The implementation 
is similar to the two dimensional line chart. Instead 
of providing two conditions (x and y axis) for each 
box, three conditions are provided (x, y, and z). 
Conditions within a box are joined by logical ORs. 
Conditions between boxes are collectively joined 
with AND conditions. 

In addition, the present invention is not re- 
stricted to graphs related with business or scientific 
data only. It can also be applied to graphs for 
multimedia applications. As depicted in Fig. 5, a 
film archival system, which when searched will 
display results in full motion video including sound, 
is an ideal application. By using the query state- 
ment to select a list of frames and by presenting 
the results in the graph window 320, this present 
invention can effectively be used to find clips within 
the database of video. One relational database ta- 
ble could contain records which each have a movie 
or selection name, the name of the file that con- 
tains the movie, a frame identifier that contains the 
offset within the file of the frame in question, and a 
time stamp for synchronization purposes where the 
frame is displayed at this time stamp. The query in 
query window 310 could read SELECT FRAMES, 
FROM movie-table, WHERE TIME > 1:00:00 and 
TIME < 1:00:30, MOVIE = "Terminator 5". This 
query statement would display 30 seconds of video 
within graph window 320. To make scrolling 
through the frames effective, buttons 365 for front, 
back, fast, slow and regular may be used in com- 
bination for fast forward (front with fast), fast rewind 
(back with fast), play (front and regular), play back- 
wards (back with regular), and single step (front or 
back with slow) could be presented and used. The 
user could then modify the query statement by 
selecting desired frames or groups of frames by 
actually selecting the images as they are displayed 
or be selecting a check box 370 as the images are 



displayed. As described above, each selection will 
modify the query statement provided in the query 
window. Of course, a separate sound query state- 
ment and window may be provided concurrently 

5 with a video window, thereby allowing the user to 
mix various media concurrently. 

The present invention has several advantages. 
Users can more easily modify a database query by 
simply manipulating a visible graph. A user may 

w investigate a particular portion of a graph without 
having to determine the exact coordinates of the 
desired portion. The user may use multiple boxes 
to specify complicated conditions. In addition, the 
information displayed in the graphs may include 

75 multimedia data such as screen images or audio 
signals. 

Claims 

20 1. An apparatus for modifying a database query 
comprising: 

means (300) for graphically displaying in 
at least two dimensions data (330) obtained 
from a database by the database query; 

25 means (335) for selecting at least one por- 

tion of the graphically displayed data (330); 
and 

means for modifying the database query 
according to the selected portion of the graphi- 
30 cally displayed data (330). 

2. The apparatus of Claim 1 further comprising 
means for iteratively actuating said means 
(300) for graphically displaying, means (335) 

35 for selecting and means for modifying. 

3. The apparatus of Claim 1 or 2 wherein the 
means (300) for graphically displaying includes 
means for graphically displaying a line chart 

40 (350) of the data obtained by the database 

query. 

4. The apparatus of Claim 3 wherein the means 
(335) for selecting includes means for utilizing 

45 a variable sized box (355,356) to select at least 

one portion of the line chart (350). 

5. The apparatus of any Claim from 1 to 4 
wherein the means for selecting (335) includes 

50 means for selecting multiple portions of the 

graphically displayed data (330). 

6. The apparatus of any Claim from 1 to 5 
wherein the means for modifying includes 

55 means for modifying the database query with a 

WHERE clause according to the selected por- 
tion of the graphically displayed data (330). 
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7. A method for modifying a database query 
comprising the steps of: 

graphically displaying in at least two di- 
mensions data (330) obtained from a database 
by the database query; 5 

selecting at least one portion of the graphi- 
cally displayed data (330); and 

modifying the database query according to 
the selected portion of the graphically dis- 
played data (330). w 

8. The method of Claim 7 further comprising the 
step of repeating the steps of graphically dis- 
playing, selecting and modifying. 



9. The method of Claim 7 or 8 wherein the step 
of graphically displaying includes graphically 
displaying a line chart (350) of the data ob- 
tained by the database query. 

10. The method of Claim 9 wherein the step of 
selecting includes utilizing a variable sized box 
(355,356) to select at least one portion of the 
line chart (350). 

11. The method of any Claim from 7 to 10 wherein 
the step of selecting includes selecting mul- 
tiple portions of the graphically displayed data 
(330). 



75 
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12. The method of any Claim from 7 to 11 wherein 
the step of modifying includes modifying the 
database query with a WHERE clause accord- 
ing to the selected portion of the graphically 
displayed data (330). 35 

13. A data processing system including the ap- 
paratus of any Claim from 1 to 6. 
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or more check boxes 
and then presses enter. 





W40 

' ( 


draw a check box under 


each bar i. or within 


eachweda 


e-designate 


check 


boxp]. 





The user clicks on zero 
or more check boxes 
and then presses enter. 

" I — " 




append "AND ("to the 
where clause of the 
SQL WHERE clause. 



FIG. 4C 



append "AND ("to the 
where clause of the 
SQL WHERE clause. 



© 



© 



© 



830 



Draw the line or scatter 
plot chart to the user's 
specificati ons. 

\ 



840 



The user marks one or 
more rectangles on the 
screen. Each rectangle 
i has a corresponding 
min (minX/Yp]) and max 
(maxX/Y[i])onboththe 
x and y axis. Show 
marked areas in 
inverted video. 




i append "AND ("to the 
where clause of the 
SQL query. 


870 


m 





For each rectangle 
marked by the user 
append a statement to 
the SQL WHERE clause 
of the form 
"(X-Axis>=minXand 
X-Axis<=maxXand 
Y-Axis>=minYand 
Y-Axis <=maxY) " 
J — 
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630 



for each check box i 
clicked on by the user 
get the record (rec) 
corresponding to text fij. 
Get value (v) of field [i] 
from rec and append 
statement of the form " 
fieldfi] =v " **** tothe 
WHERE clause. Append 
OR to the SQL WHERE 
clause if i is not the last 
checkbox. 



640 



Append") "tothe 
end of the WHERE 
clause. 



T 

© 



f 



for each check box i 
clicked on by the user, 
append ranges [i] to 
the WHERE clause. 
Append "OR "to the 
WHERE clause if i is 
not the last check box. 



780 



790 



Append") "tothe end 
of the SQL WHERE 
clause. 



T 

© 



© 







Append OR to the 
SQL WHERE clause 
if i is not the last 
marked rectangle. 




, ^"890 


Append") "tothe 
end of the WHERE 

clause. 




r 



© 



FIG. 4D 
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